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TO ALL WHOM IT MAY CONCERN: 

Be it known that we, Yu-Jung Cheng, Yu-Sheng Weng and Chin- Wei Chang, all 
citizens of Republic of China, residing at No. 43, Lane 112, Bay Chi Rd., Yuan Shun Village, 
Elen Hsien, Taiwan, R.O.C., No. 8, Alley 55, Lane 152, Ray Song Street, Shi Chiu, Taipei 
Hsien, Taiwan, R.O.C., and No. 41, Lane 243, Dong Chi Street, Dong Shi Town, Tai Chung 
Hsien, Taiwan, R.O.C., have invented new and useful improvements in 

"SYSTEM AND METHOD OF REAL-TIME INTERACTION 
FOR MULTIPLE OBJECTS" 



for which the following is a specification. 
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TITLE 

SYSTEM AND METHOD OF REAL-TIME INTERACTION FOR MULTIPLE OBJECTS 

BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to a system and method of 
real-time interaction for multiple objects, and particularly to 
a system and method of real-time interaction for multiple 
objects that employs multiple servers to control respective 
scenes and synchronizes between these servers only as necessary, 
so as to balance the loads on these servers and reduce the costs 
of communication between them. 

Description of the Related Art 

In conventional system of real-time interaction for 
multiple objects (the system also can be called a multi-user 
real-time interaction system) , system messages are communicated 
via client/server architecture. In current multi-user real- 
time interaction system, such as online games, a single server 
is always employed to control a single scene. 

Fig. 1 shows an example of a multi-user real-time 
interaction system with client/server architecture. In this 
system, three scenes (20, 21, and 22) are controlled by three 
servers (10, 11, and 12) respectively. Each of the servers (10, 
11, and 12) can be composed of several server programs, and 
provide service to the clients (30, 31, and 32) accessing the 
scenes (2 0, 21, and 22) respectively. In such systems, it is 
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easy to construct and maintain the system, however, the 
expansibility of the system is limited and the function of 
dynamic expansion and fault tolerance will be hard to achieve. 

In order to overcome these drawbacks and further provide 
the function of dynamic expansion and fault tolerance 
conventionally, multiple servers are employed to control one 
scene. In Fig. 2, scene 2 0 is controlled by three servers 10, 
and each of the servers 10 can provide service to the clients 
30 accessing the scene 20, and scene 21 is controlled by three 
sei-vers 11, and each of the servers 11 can provide service to 
the clients 31 accessing the scene 21. 

A system employing multiple servers to control one scene 
can solve the drawbacks of the system in Fig. 1, however, a large 
amount of communication between servers for synchronizing the 
scenes reducing the efficiency of the system. 

SUMMARY OF THE INVENTION 

It is therefore an object of the present invention to 
provide a system and method of real-time interaction for 
multiple objects that employs multiple servers to control 
respective scenes, so as to balance loads on these servers, and 
synchronizes between these servers only as necessary, so as to 
reduce the costs of communication between them. 

To achieve the above objects, the present invention 
provides a system and method of real-time interaction for 
multiple objects. According to the embodiment of the invention, 
the system of real-time interaction for multiple objects 
includes a scene dividing module, a first control unit, a second 
control unit, and a synchronization module. 
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The scene dividing module divides a main scene into a first 
scene and a second scene, and determines the adjacent area of 
the first scene and the second scene. The first control unit 
controls at least one object in the first scene, and the second 
control unit controls at least one object in the second scene. 
When the status incidence of the objects controlled by the first 
control unit and/or the second control unit overlaps the 
adjacent area of the first scene and the second scene, the 
synchronization module enables the first control unit to 
synchronize with the second control unit. 

According to the embodiment of the invention, the method 
of real-time interaction for multiple objects, first, a main 
scene is divided into a first scene and a second scene, and the 
adjacent area of the first scene and the second scene is 
determined. Then, at least one object in the first scene is 
controlled by a first control unit, and at least one object in 
the second scene is controlled by a second control unit. 
Finally, the first control unit is synchronized with the second 
control unit if the status incidence of the objects controlled 
by the first control unit and/or the second control unit overlaps 
the adjacent area of the first scene and the second scene. 

In addition, the scene dividing module further divides the 
first scene into a first sub-scene and a second sub-scene if the 
number of objects controlled by the first control unit is more 
than a load threshold, and then the objects in the first 
sub- scene are controlled by the first control unit, and the 
objects in the second sub- scene are controlled by a third 
control unit , 
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Further, the scene dividing module divides the main scene 
into the first scene and the second scene according to the 
potential visible set (PSV) and grid. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The aforementioned objects, features and advantages of 
this invention will become apparent by referring to the 
following detailed description of the preferred embodiment with 
reference to the accompanying drawings, wherein: 

Fig. 1 is a schematic diagram showing the system structure 
of a multi-user real-time interaction system with client/server 
architecture; 

Fig. 2 is a schematic diagram showing the system structure 
of a multi-user real-time interaction system that employs 
multiple servers to control one scene; 

Fig. 3 is a schematic diagram showing the system structure 
of a system of real-time interaction for multiple objects 
according to the embodiment of the present invention; 

Fig. 4 is a schematic diagram showing the synchronization 
process between control units; 

Fig, 5a shows the rooms of an indoor scene; 

Fig. 5b shows indoor scenes in Fig. 5a with grids; 

Fig. 5c shows the result of further dividing indoor scenes 
in Fig. 5b; 

Fig. 6 shows the scene structure of indoor scenes after 

dividing ; 

Fig. 7a shows a outdoor scene; 

Fig. 7b shows outdoor scenes in Fig. 7a with grids; 
Fig. 7c shows the result of dividing outdoor scenes in Fig. 
7b ; and 
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Fig. 8 is a flow chart illustrating the operation of a 
method of real-time interaction for multiple objects according 
to the embodiment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
Fig. 3 shows the system structure of a system of real-time 
interaction for multiple objects according to the embodiment of 
the present invention. Referring to Fig. 3, the system provides 
real-time interaction for multiple users (clients 400, and410), 
the system includes a scene dividing module 100, a first control 
unit 200, a second control unit 210, and a synchronization module 
300. 

The scene dividing module 100 divides a main scene 110 into 
a first scene 111 and a second scene 112, and determines the 
adjacent area 113 of the first scene 111 and the second scene 
112. It should be noted that the scene dividing module 100 
divides the main scene 110 into the first scene 111 and the second 
scene 112 according to the potential visible set (PSV) and grid, 
and the dividing method will be discussed later. 

The first control unit 200 controls the objects (not shown) 
corresponding to the clients 400 in the first scene 111, and the 
second control unit 210 controls the objects (not shown) 
corresponding to the clients 410 in the second scene 112. The 
first control unit 2 00 and the second control unit 210 may be 
server programs or groups of several server programs, and the 
first control unit 200 and the second control unit 210 are 
responsible for handling the behavior of respective objects, the 
states of the scenes, the interaction between objects, and the 
events produced by the scene, such as event trigger, event close, 
and the status of events . 
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When the status incidence of the objects controlled by the 
first control unit 2 00 and/or the second control unit 210 
overlaps the adjacent area 113 of the first scene 111 and the 
second scene 112, the synchronization module 3 00 enables the 
5 first control unit 200 to synchronize with the second control 
unit 210. The synchronization process includes exchanging the 
information of the behavior of respective objects, the states 
of the scenes, the interaction between objects, and the events 
ja^ produced by respective scenes, such as event trigger, event 

O 10 close, and the status of events between two control units. 

SI 

tjl It should be noted that the status incidence represents the 

ai 

ll'l range that can be affected by the behavior of an object. Fig. 

^ 4 shows the synchronization process between control units. In 

O Fig. 4, there are four objects (A, B, C, and D) in the main scene 

fll 

110. Object A and object B are positioned in the first scene 

111. and controlled by the first control unit 200. Object C and 
rti object D are positioned in the second scene 112, and controlled 

by the second control unit 210. In Fig. 4, the status incidence 
of the object can be denoted by a circle in plane. 

In this case, object B is in the first scene 111, however, 
the status incidence of object B overlaps the adjacent area 113, 
which means the behavior of object B may affect the second scene 

112. The synchronization module will detect this situation (the 
status incidence of object B and the adjacent area 113 are 
overlapped) , and then enable the first control unit 2 00 and 
second control unit to synchronize. If object B moves to the 
second scene 112, object B will be taken over by the second 
control unit 210. 

Further, the scene dividing module 100 further divides the 
first scene 111 into a first sub-scene (not shown) and a second 
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sub-scene (not shown) if the number of objects controlled by the 
first control unit 200 is more than a load threshold, the objects 
in the first sub- scene are controlled by the first control unit 
2 00, and the objects in the second sub -scene are taken over by 
a third control unit (not shown) , so as to maintain load balance 
of the entire system. In addition, if a failure occurs in the 
first control unit 2 00 or the first control unit 2 00 is 
suspended, the first scene 111 and objects controlled by the 
first control unit 200 can be taken over by another control unit . 
In one aspect, the third control unit can be set as the control 
unit that controls the scene adjacent to the scene controlled 
by the failure control unit. 

It should be noted that the connection relation between 
control units may be determined according to the adjacent 
relation between scenes. The control units that control 
adjacent scenes may connect as a peer to peer structure or a 
multicast group structure. 

The dividing method that employs the potential visible set 
(PSV) and grid is described as follows. 

A virtual world (scene) always includes indoor and outdoor 
scenes . Indoor scenes may be composed of several rooms or closed 
regions, the visible relation between adjacent rooms can be 
acquired according to the position of these rooms, and the 
visible relation can be used as the connection relation of these 
rooms. Outdoor scenes may be considered as an open 3D scene, 
users can freely move in these scenes, and the visible range is 
more broad. According to the embodiment, the dividing methods 
for indoor scenes and outdoor scenes may be different, described 
as follows. 
Indoor Scene 
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Fig. 5a shows the rooms 50 of an indoor scene, the broad 
line represents the portal 51 of the room 50 . In the embodiment, 
indoor scenes can be defined as a main scene in level 1, and each 
of the rooms 50 can be defined as level 2 scenes, such as the 
first scene and the second scene described above. Further, each 
of the rooms 50 may be divided into sub-scenes in the next level. 

Before dividing the rooms 50 into sub- scenes, in order to 
determine the adjacent area of scenes, grids are added to indoor 
scenes in Fig. 5a. Fig. 5b shows indoor scenes with grids, and 
the gray grids represent the adjacent areas 52. Next, since the 
area of room 3 and room 4 is larger than the other rooms, room 
3 and room 4 can be further divided into two sub-rooms, and the 
adjacent area 53 of sub-rooms also can be acquired, as shown in 
Fig. 5c. The entire scene structure of indoor scenes can be 
represented as Fig. 6. 
Outdoor Scene 

For simple description, outdoor scenes is discussed in 2D. 
As an example, outdoor scenes 7 0 is shown in Fig 7a, and the range 
covered by outdoor scenes can be determined by adding grids to 
outdoor scenes 70, as shown in Fig. 7b. 

Then, outdoor scenes 70 can be divided according to the 
coverage relation between grids and outdoor scenes 7 0 and the 
maximum bounding box. In this case, since the maximum bounding 
box is similar to a square or a rectangle, outdoor scenes 70 can 
be divided into four scenes (71, 72, 73, and 74) , and the adjacent 
area of these scenes also can be acquired, as shown in Fig. 7c. 
The dividing method for each of the scenes (71, 72, 73, and 74) 
is omitted, since it is similar to the indoor scene. In addition, 
if outdoor scenes is an irregular shape, the divided scene can 
be combined with its adjacent scene according to its area, so 
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as to average the area of scene controlled by each of the control 
units . 

Next, Fig. 8 shows the operation of a method of real-time 
interaction for multiple objects according to the embodiment of 

5 the present invention. 

First, in step S80, a main scene 110 is divided into a first 
scene 111 and a second scene 112, and in step S81, the adjacent 
area 113 of the first scene 111 and the second scene 112 is 
determined. Then, in step S82, the objects in the first scene 

10 111 are controlled by a first control unit 200, and the objects 
in the second scene 112 are controlled by a second control unit 
210. Similarly, the first control unit 200 and the second 
control unit 210 may be server programs or groups of several 
server programs, and the first control unit 200 and the second 

15 control unit 210 are responsible for handling the behavior of 
respective objects, the states of the scenes, the interaction 
between objects, and the events produced by the scene, such as 
event trigger, event close, and the status of events. 

Finally, in step S83, the first control unit 200 is 

20 synchronized with the second control unit 210 if the status 
incidence of the objects controlled by the first control unit 
2 00 and/or the second control unit 210 overlap the adjacent area 
113 of the first scene 111 and the second scene 112. Similarly, 
the synchronization process includes exchanging the information 

25 of the behavior of respective objects, the states of the scenes, 
the interaction between objects, and the events produced by 
respective scenes, such as event trigger, event close, and the 
status of events between two control units. 

Further, the first scene 111 can be further divided into 

30 a first sub-scene and a second sub-scene if the number of objects 



9 



Client's ref.: STLC-02 -D9021 

Our ref : 0213 -7395 -USf/yianhou/kevin 

controlled by the first control unit 200 is more than a load 
threshold, and then the objects in the first sub- scene are 
controlled by the first control unit 200, and the objects in the 
second sub-scene are taken over by a third control unit. 
Furthermore, if a failure occurs in the first control unit 2 00 
or the first control unit 2 00 is suspended, the first scene 111 
and objects controlled by the first control unit 200 can be taken 
over by another control unit . 

According to the embodiment, each of the scenes and the 
corresponding control unit can be clearly determined according 
to the scene structure. The distribution of scene is from level 
1, if the main scene needs to be controlled by more control units, 
the scene distributed to each of the control units can be 
determined according to the scenes in level 2 of the scene 
structure . 

As a result, using the system and method of real-time 
interaction for multiple objects according to the present 
invention can employ multiple servers to control respective 
scenes, so as to balance the loads in these servers, and 
synchronize between these servers only as necessary, so as to 
reduce the costs of communication between them. 

Although the present invention has been described in its 
preferred embodiment, it is not intended to limit the invention 
to the precise embodiment disclosed herein. Those who are 
skilled in this technology can still make various alterations 
and modifications without departing from the scope and spirit 
of this invention. Therefore, the scope of the present invention 
shall be defined and protected by the following claims and their 
equivalents . 
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